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ABSTRACT 


This thesis applies data analysis and casual forecasting methods to the 
problem of predicting 5"/54 caliber gun ammunition non-combat 
expenditure requirements (NCERs) for U.S. Pacific Fleet surface 
combatants. The NCER is the amount of ammunition required for non- 
combat purposes for a given fiscal year. Current methodology does not 
consider past expenditure data when predicting future requirements and 
significantly overestimates them. The author takes advantage of the fact 
that similar ship types follow an identical notional training cycle between 
overseas deployments leading to distinct expenditure patterns. This thesis 
shows that improvements to current NCER determination procedures can 
be achieved using historical consumption data as a function of ship type 
and relative position in the interdeployment training cycle. The results 


include a significant reduction in requirements overestimation and more 


accurate annual ammunition planning factors. 
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EXECUTIVE SUMMARY 


U. S. Navy surface combatants expend gun ammunition every day 
conducting training exercises designed to improve crew and gun system 
proficiency. These exercises are elements of the interdeployment training cycle 


designed to ensure high states of readiness for deploying ships. 


At some point, planners must predict the amount of ammunition required 
for training by the fleet for the upcoming fiscal year. These estimates, known as 
the non-combat expenditure requirements (NCER), are currently severely 
overestimated. This is not surprising since no scientific methodology is currently 


being used to predict these numbers. 


Current NCER methodology does not consider past expenditure patterns 
or future ship schedules in predicting fiscal year requirements, and fleet 
ammunition requirements appear to be educated guesses. Subsequent 
distribution of the approved non-combat expenditure allocation (NCEA) is done 
using a fair-share policy with no regard for a ships schedule. A ship entering the 
shipyard receives the exact same allocation as one beginning a deployment or 
one entering the height of the training cycle. Furthermore, the fleetwide NCEA 
was significantly overestimated in FY-94 only to be increased by approximately 
15% for FY-95. Yearly expenditures have been dropping since at least FY-92, 
and this action suggests that past expenditure data is not being considered in 


the decision making process. 


Xill 





This thesis identifies one alternative method to the current requirements 
determination procedures. Data analysis and casual forecasting methods are 
applied to the problem of predicting 5’/54 caliber gun ammunition non-combat 
expenditure requirements (NCER) for U.S. Pacific Fleet surface combatants. 
This is possible due to the fact that similar ship types follow the same notional 


training cycle between deployments. 


Raw expenditure data from the Conventional Ammunition Integrated 
Management System (CAIMS) was used after extensive validation. Twelve- 
month demand distributions were developed based on the interdeployment 
training cycle for nine ammunition classes. The data points were generated by 
taking all possible occurrences of the random 12-month window on the training 
cycle. After outlier processing, fitted equations were transferred to a simple 
spreadsheet to form the forecasting model. The inputs to the model are ship 
type and months before deployment, and the output is the expected fiscal year 
requirements for each ammunition family. Standard deviations are also 


calculated to aid the decision maker. 


This thesis shows that improvements to current NCER determination 
procedures can be achieved using historical consumption data as a function of 
ship type and relative position in a ships interdeployment training cycle for 5°/54 
caliber ammunition. FY-92 through FY-94 data was analyzed and used to 
predict FY-95 requirements. The results summarized in the graph below include 


a significant reduction in requirements overestimation and more accurate 
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ammunition planning factors than are currently available. Based on FY-95 
expenditures, these improvements to the NCER determination process may 
immediately result in an estimated 30% reduction in initial procurement costs per 
year as well as save time and money currently spent to manage, inspect, track, 


and store excess ordnance. 


NCEA and Model Forecasts versus Predicted Actual Expenditures 
FY-95 
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This graph depicts the potential savings that can be achieved due to decreased 
overestimation of the fleet NCER using the model presented in this thesis. The leftmost 
bar in each series is the NCEA -- the current prediction. The middle bar is the model’s 
prediction, and the rightmost bar is the estimated FY-95 actual expenditures. (Note: 
The first series, FSC, is divided by 10 fo allow it to fit on this graph.) 
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I. INTRODUCTION 


A. THE RESEARCH PROBLEM 

U.S. Navy surface combatants expend gun ammunition every day 
conducting training exercises designed to improve crew and gun system 
proficiency. Specific exercises requirements are listed in the Navy’s Surface 
Force Training Manual. [Ref. 1] This consolidated training document dictates 
the specific exercises that must be satisfactorily completed by each type of ship 
during the standard training cycle to maintain acceptable levels of readiness. 
Individual exercises require various types and quantities of ammunition and are 


conducted at various times in a ships interdeployment training cycle. 


Like many cycles, there exist periods of high and low expenditures that 
are a function of many factors including ship type and number of months 


remaining in the interdeployment training cycle. 


The cost of all 5°/54 caliber rounds expended for training and non-combat 
operations in the Pacific Fleet is in excess of ten million dollars per fiscal year. 
Consequently, the logistics system which supports the interdeployment training 
cycle deserves to be managed effectively to reduce inefficiencies, save money, 
and ensure that a strong support system exists in the future. Unfortunately, very 
little quantitative analysis takes place to improve this complicated process. 


Specifically, no concrete analysis is presently being applied to accurately predict 





the non-combat requirements of ammunition needed to maintain fleet readiness 


at acceptable levels. 


The result of this lack of analysis is significant overestimation of non- 


combat ammunition expenditure requirements each fiscal year. 


B. OVERVIEW 

This thesis applies data analysis and casual forecasting methods to the 
problem of predicting non-combat expenditure requirements (NCERs) of naval 
gun ammunition for surface combatants of the U.S. Pacific Fleet. Improvements 
to current NCER determination procedures are achieved using historical 
consumption data as a function of ship type and relative position in the 
interdeployment training cycle resulting in less overestimation and more 


accurate predictions than are currently available. 


Chapter II of this thesis provides pertinent background information about 
the Navy, its conventional ammunition management program, and the 
interdeployment training cycle, that drive the expenditure of ammunition. 
Chapter Ill provides the motivation for this thesis based on the author's 
experience tour. Chapter IV formally states the problem, Chapter V discusses 
the sources of data gathered for this study, Chapter Vi discusses the 
methodology and data analysis, and Chapter VII discusses results, conclusions, 


and suggestions for further study. 














Appendices are included that document specifics including the rather 
extensive data validation procedure, ammunition family groupings, outlier 
statistics, NCER forecasting graphs, forecast standard deviations, and the FY-95 


NCER forecast worksheet. 
C. SCOPE 


This thesis will analyze the non-combat expenditure data of Pacific Fleet 
cruisers and destroyers expending 5”/54 caliber ammunition. Smaller rounds of 
ammunition are relatively inexpensive and difficult to manage, and larger 
munitions (i.e., missiles) are tracked extremely closely and do not present as 
large a potential for improvement. Amphibious assault ships, Arleigh Burke 
Class destroyers, and nuclear cruisers will be mentioned briefly but are not 
analyzed due to the relatively small numbers of these ships compared to the 


study group and due to the small amounts of data they represent. 











ll. | BACKGROUND INFORMATION 


This chapter provides background information necessary for a basic 
understanding of the nature of this problem. Those familiar with the U.S. Navy 
and the interdeployment training cycle may skip this chapter with no loss of 


continuity. 


A. U.S. NAVY SHIPS 

U.S. Navy ships are divided into ship types according to their design and 
primary mission area (PMAs). Ship types are further divided into classes, 
named after the lead ship of the class. The ships with primary missions 
containing the word “warfare” are considered to be surface combatants, while 
those having the primary mission of support are considered to be combat 
logistics force (CLF) ships. A partial listing of some ship types, primary mission 


areas, ship classes, and class names appears in Table 1. 





Table 1. Partial Listing of Ships by type, PMA, class, and name. 












Upon commissioning, U.S. Navy ships are assigned to the Atlantic or the 
Pacific Fleet and begin a continuous cycle of maintenance and training to 
ensure combat proficiency for routine deployments and crisis response to global 


contingencies. 


B. PACIFIC FLEET TRAINING ORGANIZATION 

The Commander-in-Chief, Pacific Fleet (CINCPACFLT), has primary 
responsibility for the tactical training of naval forces to be provided to the Unified 
Commander. Ships joining the Pacific Fleet are initially assigned to the 
Commander, Naval Surface Force Pacific (SURFPAC). Under CINCPACFLT's 
tactical training strategy, PMA tactical training is executed by SURFPAC in the 
initial phases of the training cycle. Once a ship is trained and equipped, it will 
change operational control (CHOP) to one of the numbered fleets, the Third, 
Fifth, or Seventh. Ships are normally assigned to the Third Fleet for operations 
near the West coast of the U.S., and CHOP to the Seventh Fleet for operations 
in the Western Pacific/Indian Ocean, or the Fifth Fleet for operations in the 


Arabian Gulf. 


There are currently 106 surface ships in the Pacific Fleet, 38 of which 
expend 5’/54 caliber ammunition. The classes and numbers of these ships are 
displayed in Table 2. For the purposes of this thesis, the CG-4/ class guided 
missile cruisers and DDG-993 class guided missile destroyers are grouped into 


one subset and the DD-963 class destroyers make up the other subset. The 











DDG-51s, LHA-1s and the CGNs are not studied in detail, so this thesis applies 





to 30 of the 38 ships mentioned above. 





Table 2. Pacific Fleet Surface Combatants Expending 5"/54 
Caliber Ammunition. The * indicates that 2.5 DDG-51s will join 
the U.S. Fleet each year. 


C. SURFACE COMBATANT TRAINING CYCLES 


1. Readiness Indicators 


Ships are required to deploy combat ready, and the Navy has developed 
a system of assigning a readiness indicator to each ship. This indicator is called 
mission rating, or “M-rating,” and is based on the ability of a ship to perform its 
primary mission. The M-rating reflects many factors including equipment 
readiness, completed exercises, and crew training. M-ratings are briefly 


summarized in Table 3. 


[Readiness | M-Rating 
“Combat Ready [om 
"Mostly Ready | M2 
-Paialy Ready [Ma 
NotReady | Ma 


Table 3. Readiness Level Description 
and Corresponding Mission Rating. 












2. Notional Training Cycles 


A notional schedule for the execution of interdeployment training has 
been established for each ship class, and all ships analyzed in this thesis follow 


the same basic notional schedule shown in Figure 1. 


(ant DDG/DD/CG Notional Schedule 
pf Basic rrainincrHase | _([inTERMEDIATE| apvaNnceD | |_| 


Unit Training COMPTUEX Battle Group 
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Figure 1. Taken from the Navy Tactical Training Manual [Ref. 2] combining the three 
ship types. The majority of the expenditures occur during ISE, TSTAs, CSA, and 
NSFS. 


There are three main phases of training depicted in Figure 1 which 


include the basic, intermediate, and advanced phases. The Surface Force 











Training Manual describes these phases in detail, but a summary of each phase 


is provided below for the reader's benefit: 


Basic Training. The focus of the basic training phase is on unit-level 
training emphasizing basic command and control, weapons employment, 
mobility and warfare specialty. After a nominal three month maintenance 
availability (SRA) or other longer overhaul period, each ship commences the 
interdeployment training cycle that will prepare it for its next deployment. 
First, each ship’s commanding officer conducts a Command Assessment of 
Readiness and Training (CART Il). The CART serves to validate and identify 
the specific training required during the upcoming interdeployment training 
cycle. This results in each ship having similar but different exercises 
scheduled for completion during Tailored Ship’s Training Availabilities 
(TSTAs). Additional requirements of the basic phase include a Combat 
systems Assessment (CSA), an Operational Propulsion Plant Examination 
(OPPE), and other maintenance availabilities as required. A Final Evaluation 
Period (FEP) is conducted at the end of the basic phase to evaluate the 
ship's readiness to proceed to the next level of training. A ship is expected to 
be substantially ready (M2) in all mission areas upon completion of the basic 
phase, and the notional training schedule is adapted by the ship's 


commanding officer and the ISIC to ensure this happens. 


Intermediate Training. The focus of the intermediate training phase is on 


warfare team training in support of the Composite Warfare Commander 


D. 





(CWC) organization. During this phase, ships are under the operational 
control (OPCON) of their numbered fleet commander (i.e., COMTHIRDFLT) 
and begin to develop warfare skills in coordination with other ships while 
maintaining their own warfare proficiency. A Missile Exercise (MSLEX) and a 
Naval Surface Fire Support (NSFS) qualification, if required, is normally 


conducted during this phase representing high gun ammunition expenditures. 


Advanced Training. The focus of the advanced training phase is on 
coordinated battle group warfare skills. This phase is conducted by fleet 
commanders and includes war gaming and a Fleet Exercise (FLTEX) 
involving the entire battle group. After completion of the advanced training 
phase, a ship is ready to deploy (M1) and must maintain proficiency by 
completing repetitive exercises. Repetitive exercises are not as logistically 
demanding as the work-up exercises discussed above (i.e., not as much 
ammunition is required, a specific range or target is not required, and certain 


training services are not required for completion). 


NAVY GUN AMMUNITION 


1. Navy Ammunition Logistics Codes (NALCs) 


All ammunition is described by a noun name and a four-digit Navy 


Ammunition Logistics Code (NALC). There are over 5000 NALCs used to 


describe different types of ammunition and ordnance componenis. 


Approximately 50 NALCs pertain specifically to 5’/54 caliber ammunition and all 


10 











Start with the letter “D” (i.e., D304, D324, and D326 for Full Service Charges). 


[Ref. 3] 


2. Expenditure Patterns 


Surface gun ammunition is expended to support a number of warfare 
areas and exercises. Normally, a five round pre-action calibration (PAC) fire will 
take place to ensure proper system operation prior to the exercise itself. The 
PAC fire normally uses D349 (BL-P) since this is an inexpensive and non- 


explosive round. 


Different types of exercises include anti-air warfare (AAW), anti-surface 
warfare (ASUW), and Naval Surface Fire Support (NSFS). During these 
exercises, combatants shoot various types of ammunition at towed surface and 
air targets as well as ground targets. Specific exercise details and ammunition 
requirements can be found in Fleet Exercise Publications (i.e., FXP-2 and FXP- 


3). 


Commanding Officers at sea frequently exercise the right to conduct 
additional training to enhance gun crew proficiency. These additional exercises 
are varied creating significant variance in the yearly expenditures for different 


ships. 


E. THE NAVY’S AMMUNITION MANAGEMENT SYSTEM 
The Navy’s conventional ammunition management system is diverse, 


complex, and not without flaws. Its mission is to provide ammunition to naval 


11 





units when needed. Structural inefficiencies exist at all levels which can be 
improved upon, but it is well beyond the scope of this thesis to attempt to 
overhaul this system. A basic understanding, however, is required to 


comprehend the problem. 


1. Non-Nuclear Ordnance Requirements (NNOR) 


For conventional gun ammunition, total Navy objectives are set by the 
Chief of Naval Operations (CNO) as a result of annual requirements reviews. 
These reviews, including the Non-nuclear Ordnance Requirements (NNOR) 
process, are high-level calculations based on models of expected world 
contingencies. Ammunition requirements generated by these studies determine 
war reserve levels and combat ship fill allowances as weil as initiate ammunition 
procurement plans and inventory policy. The war reserve and ship fill figures 
are classified information and will be considered fixed for the purpose of this 


thesis. 


2. Non-Combat Expenditure Allocations (NCEA) 


The ordnance fired every day for fleet training and exercises is allocated 
to each ship yearly by its respective type commander (TYCOM) as a Non- 
combat Expenditure Allocation (NCEA). For the Pacific Fleet, SURFPAC is the 
TYCOM for all surface combatants. A ship is allowed to expend this NCEA for 
training and completion of required exercises, and must request an NCEA 
augment by naval message to expend a higher level of ammunition. As one 


would suspect, not all of the available ammunition is allocated, and the TYCOM 
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maintains a reserve level to allocate in the event of extreme circumstances and 


NCEA augment requests. 


3. Non-Combat Expenditure Requirements (NCER) 


For 5°/54 caliber ammunition, the sum of all of the NCEAs for all ships 
comprises the fleet’s Non-combat Expenditure Requirements (NCER) which are 
provided as inputs to the FLTCINC and passed to the CNO (See Figure 2). The 
CNO, in turn, modifies these requirements as necessary taking into account 
current assets and budgetary constraints. The CNO then allocates the fleet 
NCEA to the FLTCINC for further distribution to the type commander. The 
NCEA number is also forwarded to Naval Sea Systems Command (NAVSEA) by 


the CNO for procurement action. 


NCER | Fleet NCEA 


FLTCINC 


Fleet NCEA 
NCER Input 
TYCOM 


| Unit NCEA 


: 





Figure 2. Flow of NCER inputs and subsequent NCEA. 








Once SURFPAC receives the fleet allocation (NCEA), it is then distributed 
to all ships in a yearly notice. [Ref. 4] Ideally, at the beginning of a new fiscal 
year, each type commander would conduct an analysis of past ammunition 
expenditures and compare them to each ships planned schedule to determine 
the best NCEAs to assign for the next fiscal year. However, at present this or 
any other formal analysis does not appear to be happening. Instead, trial and 
error estimation reinforced by “fleet experience” appear to be the guiding 
principles resulting in all ships receiving the same allocation of ammunition 


regardless of their upcoming schedule. 
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il. THESIS MOTIVATION 


A. MOTIVATION 

A 1983 audit by the Department of Defense Inspector General found that 
many fleet commander procedures were contrary to effective management of 
ammunition. [Ref. 5] Rather than base the NCER on actual training needs, the 
NCER was based solely on aggregated historical expenditure. What the entire 
fleet expended the past fiscal year was generally considered a good 
approximation for the next year’s requirements. Consequently, NCEAs were 


distributed to ships with no regard for the ship’s schedule or type of ship. 


Compounding the problem, consumption of ammunition was monitored at 
the fleet vice the unit level -- allowing certain ships to expend over twice their 


allowance without alerting the fleet commander to the problem. 


Similar inefficiencies still exist today in this complicated system. The 
author was exposed to related discrepancies while on experience tour at 
COMNAVSURFPAC in San Diego, CA. One senior officer in the fleet 
requirements branch commented that the Navy’s ammunition system is “broken” 
and any studies that could be done to help the system would be beneficial — 
starting at the ground level. A clear understanding that the NCER determination 
process was complex and confusing existed resulting in NCEAs being assigned 
to individual ships using a fair-share policy. Data analysis is not done currently 


due to the complexity of the problem. The fleet NCEA allocated to SURFPAC by 
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the CNO and CINCPACEFLT is simply divided by the number of 5°/54 caliber 


barrels in the fleet and then appropriately apportioned to each ship’s NCEA. 


As a means for resolving different ships’ requirements, squadron/group 
commanders are authorized to redistribute NCEAs as they deem necessary to 
ships under their command, but this practice will not be a viable solution in the 
future. The latest fleet organization calls for the entire squadron/group of ships 
to deploy together in the same battle group. This will result in all of their training 
cycles being synchronized and all of their requirements being very similar (either 
high or low). This will place even more importance on the ammunition 


requirements determination process in the future. 


B. PAST NCER REQUIREMENTS METHODOLOGY 

The last known attempt at 5’/54 caliber fleet level NCER methodology 
was promulgated by the CNOQ’s office in October 1991. [Ref. 6] This confidential 
notice, entitled “NCER Methodology,” listed planning factors for determining 
each ship’s expected expenditures based on the major exercises the ship was to 
participate in during the next fiscal year. These categories included exercises 
such as type commander exercises (TYPEX), independent steaming exercises 
(ISE), Naval Surface Fire Support (NSFS), spotter services, refresher training, 


and fleet exercises (FLTEX). 


By knowing each ships detailed schedule, a decision maker could use 


these planning factors to estimate the ammunition requirements for the next 
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fiscal year. This system, however, failed due to the inaccuracy of these 
estimates. Each estimate was generally too high for each individual ship which 
became amplified and caused gross overestimation when aggregated to the fleet 


level. 


Factors such as target availability, system casualties, and range 
availability all affect the final quantity of ammunition expended to complete an 
exercise. These factors generally force each ship to expend less ammunition 
than planned. The formal NCER methodology appears to have been 


discontinued. 


C. CURRENT NCER DETERMINATION PROCESS 


The current NCER process at the fleet level does not consider 
deployment cycle, ship type, maintenance schedules, or any other of a number 
of factors affecting the expenditure of ammunition. Every ship with two guns is 
assumed to require the same amount of ammunition. This policy may be 
inefficient, but it ensures that all ships feel equally important. Furthermore, it is 


easy to apply and much easier to justify than other methods. 


As discussed in the previous chapter and depicted in Figure 1, a notional 
training cycle exists for each ship. This interdeployment training cycle is 
normally 18-21 months in duration with some variation. Deployment data for the 


ships studied in this thesis yields the mean cycle times displayed in Table 4. 
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CG-47/DDG-993 


DD-963 
Table 4. Mean Interdeployment Cycle Times (in months). 





The author speculates that the older DD-963 class ships spend a few 
extra months between deployments taking advantage of maintenance 


availabilities, but has no evidence to support this. 


The difficulty associated with predicting the proper NCEA for a particular 
ship is that this number is based on the fiscal year and the training cycle is not. 
Therefore, the 12-month fiscal year window associated with the NCEA falls 
randomly onto the 18-21 month cycle. For this reason, fiscal year expenditures 


(corresponding to NCEA) will always be a random variable. 


Figure 3 shows the actual expenditures of Full Service Charges versus 
the predictions (NCEA) for all Pacific Fleet ships over the past 4 fiscal years to 


illustrate the problems with current methodology. 
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Actual Expenditures versus NCEA 
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Figure 3. Actual Expenditures versus NCEA for Full Service Charges (FY 92-95). Expenditures 
for the first six months of FY-95 were almost 5000 rounds. Using the worst, and unlikely, case of 
a 200 % increase in expenditures the last half of the year still shows significant overestimation. 


Figure 3 clearly shows the overestimation taking place on the order of six 
to ten thousand rounds per year. The decreasing NCEA figures seemed to be 
converging to actual expenditure levels from FY 92-94, but FY-95 will certainly 
be the worst prediction of all. There is no way to justify an increase in FY-95 
requirements if past expenditure data is taken into account. Obviously, no 
learning curve exists, NCEA forecasts are simply guesswork, and this problem 


requires an analytical study to improve the process. 


Six of the nine ammunition families have consistently been overestimated 


in the past 3 fiscal years. Of the remaining three, HE-PD and HE-CVT were 
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underestimated in FY-92 and 93 i overestimated in FY-94, and Reduced 
Charges were the reverse of this. All of the NCEAs have been raised for FY-95, 
which causes substantial overestimation. This results in high inputs leading to 
the procurement of excessive 5’/54 caliber ammunition which will need to be 


stored and maintained until it can be used. 


D. FURTHER MOTIVATION 
Members of the SURFPAC ordnance shop feel that this problem Is too 
complex to model and none of them have the time required to undertake such a 


project. These two factors make this an ideal thesis opportunity. 
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IV. PROBLEM STATEMENT 


The goal of this thesis is to apply basic OR analysis techniques to readily 
available data to improve the 5°/54 caliber NCER determination process for 
Pacific Fleet surface combatants. The development of planning factors and the 
reduction of fleetwide overestimation can only improve the Navy’s vast 


conventional ammunition management system. 
To this end, the following assumptions were made: 


e Current readiness levels are acceptable. In fact, surface ship combat 


readiness levels are the highest they have been in decades. 


e The CAIMS data used in this thesis is accurate after the procedures 
described in Appendix A are applied. This readily available data was not 
without peculiarities and required significant validation before it was 


usable. 


e Better NCEA estimates at the fleet level will improve the Navy’s overall 


ammunition program. 


The system is too large for this thesis alone to fix. However, this thesis 
does show that all ships do not expend the same amount of ammunition over a 
fiscal year and that historical data can be used to improve the requirements 


determination process for future fiscal years. 
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V. DATA 


A. CAIMS EXPENDITURE DATA 

Most of the data used in this thesis comes from the Conventional 
Ammunition Integrated Management System (CAIMS) database at the Naval 
Ordnance Center (NOC) in Mechanicsburg, Pennsyivania. CAIMS is basically 
an accounting system and it is generally not revered by analysts as a good 
source of accurate information on ammunition expenditures and real-time on- 
hand quantities. Despite these perceived shortfalls, CAIMS accuracy is 
considerably high (about 98%), and there are CAIMS terminals at SURFPAC 


which facilitate easy access to this data for the analyst or decision maker. 


All ammunition transactions are reported to CAIMS within 24-48 hours of 
occurring. Examples of transactions that are reported include: training 
expenditures, operational expenditures, ammunition transfers, and losses or 
gains of ammunition due to clerical errors. There is no way of backdating 
transactions, so CAIMS records these transactions as they are received. This 
results in many difficulties in analyzing the raw data. For example, if a ship 
expended 35 rounds of BL-P ammunition for training in July 1994, the following 


could happen: 


First, the ship actually expends 35 rounds of D341 (BL-P projectiles) and 
35 rounds of D326 (Full Service Charges), but accidentally reports 25 rounds of 


each with a typographical error reporting D324 instead of D326. Lines 1 and 2 
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of Figure 4 would be generated and recorded in the CAIMS database. Second, 
this same ship submits a correction in July of 1994 resulting in the data in lines 
3-5. Line 3 corrects the D324 typographical error, line 4 correctly reports the 

actual expenditure of D326, and line 5 reports the expenditure of the additional 


10 rounds of D341. 


Transaction # Date NALC Family Qty Reason 
Originally Reported Transactions: 


1 May 94 D324 FSC 25 Training 
2 May 94 D341 BL-P 25 Training 


Follow-up Correction Transactions: 


3 July 94 D324 FSC -25 Clerical Error 
4 July 94 D326 FSC 35 Clerical Error 
5 July 94 D341 BL-~P 10 Training 


Figure 4. Sample CAIMS data. 


Obviously, this data is not useable in this form. A manual interpretation of 
the reported data is required to transform these transactions into actual 
expenditure data. Note that the analyst must be careful not to misinterpret the 
data. In this case, one could mistakenly deduce that 25 rounds of BL-P was 
expended in May and 10 rounds of the same ammunition expended in July. For 


this reason, painstaking reviews of each ships reported expenditures Is 
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necessary to accurately piece together the actual expenditures. Specific 


procedures used to validate the data for this thesis are detailed in Appendix A. 


It is interesting to note that while the data from FY 92-94 contained a 
small percentage of negative entries, FY-95 data contained none. A 
representative at NOC reported that no major changes had taken place in the 
database, and that the reports must have simply been formatted differently. It 
appears that analyses similar to this can be done with increasing ease in the 


future. 


B. CAIMS NCEA DATA 

The NCEA data from the CAIMS database included all fiscal year initial 
NCEA figures from FY 92-95 as well as each augmentations given throughout 
the year. The number of augments requested was considerably low meaning 


that current predictions satisfy almost all of the ships in the Pacific Fleet. 


C. DEPLOYMENT DATES/EMPLOYMENT SCHEDULES 


The Operations Department at SURFPAC (N-3) is responsible for all 
Pacific Fleet surface ship schedules. Current software in use contains data on 
every major exercise or event a ship participates in, but only the deployment 


dates were considered for this thesis. 
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D. | COMMISSIONING/DECOMMISIONING DATES 


Commissioning and decommissioning information was received from the 
Public Affairs Officer at SURFPAC and was used as a basis for omitting recently 


commissioned ships. 


E. OVERHAUL/MAJOR MAINTENANCE DATES 

Major maintenance availability dates, completed and scheduled, are 
available through the Supervisor of Shipbuilding (SUPSHIP) for each ships’ 
respective region. A majority of the ships in this thesis are covered by SUPSHIP 
San Diego, but approximately seven are not. This data is incomplete and is not 


incorporated into this thesis. 


F. OTHER DATA 


Other sources of data are listed in the bibliography and include ship 
names, NALC information, and ammunition families. This data was used to 


classify ships and make the data more easily manageable. 
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VI. METHODOLOGY AND ANALYSIS 


A. DATA COLLECTION AND ORGANIZATION 

There were 27 NALCs represented in the data set that were placed into 
the nine categories of NCEA issued by SURFPAC. Although the NCEA is 
established for a single NALC, there are many NALCs in similar “families” of 
ammunition that may be substituted. The families of ammunition and the 
groupings are listed in Appendix B. Family groupings for this thesis were made 
based on the NALC manual [Ref. 3] and the SURFPAC cross reference list. [Ref. 
4] The costs of each round expressed in 1995 dollars is also included in 


Appendix B. 


B. METHODOLOGY 

Expenditure data was downloaded onto floppy disks and imported into 
Microsoft Excel 5.0 for validation, organization, and analysis. Microsoft Excel 
5.0 proved to be invaluable as a tool for all aspects of the data analysis 
including list processing, automatic summary tables, and curve fitting. The 


following phases of analysis occurred: 


1. Twelve-Month Moving Windows of Historical Expenditures 


The data was organized onto a timeline with the deployment dates 
superimposed onto the data. Twelve-month moving “windows” were placed at 
every possible month between deployments ensuring that no deployment 


months were included in the fiscal year window. This procedure was used to 
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produce the data series of random yearly expenditures used for the forecasts. 
The sums of the expenditures in each 12-month window form data points for the 
forecasting graphs in Appendix D. The data in each series is highly correlated 


and interdependent, so each series was treated as a set of data. 


2. Outlier Determination 


Data series containing all zero entries were assumed to be unusual and 
were deleted. Additionally, data series with points lying outside 2 standard 
errors were carefully examined and considered for deletion. Equation 1 was 
used to calculate standard error about the mean, or the unbiased estimator of 
the population standard deviation. This gave the widest acceptance region to 


allow more of the data to be inciuded. 


StdError = 





Equation 1. Standard Error Equation. (where n= number of 
data points in each time slot, 1 = mean of each time slot, and 
x; = data points in each time slot.) 


It is usually true that 95% of the data points will lie within two standard 
errors of the mean. [Ref. 7] Those falling outside of this range were 
considered as possible outlying points. Each outlying point was considered 
individually taking into account the other data points in the series. If it was 


determined that the data series was not representative of the overall data or 
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if unusual expenditure patterns were discovered, that entire data series was 


deleted. The results of eliminating the outliers is summarized in Appendix C. 


3. Fitted Historical Demand Curves 


The data was split into two groups, DDs and CGs, and plotted using 
months before deployment as the independent variable and yearly expenditures 
as the dependent variable. Sixth order polynomial equations were fit to this data 
and used for casual forecasting. The resulting 18 graphs are included in 
Appendix D. Note that the polynomial equation fit through the data lies very 
close to the mean of the expenditures in each time slot. The standard deviations 


for each time period are listed in Appendix E. 


4. NCEA/NCER Forecast Worksheet 


The equations of each of the 18 sets of data were transferred to a 
Microsoft Excel Worksheet to assist the decision maker in quick and easy 
determination of baseline NCEAs and a fleet NCER. The number of months until 
the next deployment is simply inserted into the shaded column, and forecasts for 
each family of ammunition are calculated using the fitted equations. Model! 
results are summarized at the bottom and compared to the actual NCEA and 
actual expenditures. The run for FY-95 is contained in Appendix F. The months 


before deployment input field and corresponding meanings are listed in Figure 5. 
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Field Entry ~ Meaning 
-20 Ship is 20 or more months before deployment at start of FY 
-19 Ship is 19 months before deployment at start of FY 


Ship begins deployment at start of FY 


Ship is in its sixth month of deployment at start of FY 


Ship has been back from deployment for one month at start of FY 





Ship has been back from deployment for nine months at start of FY 


Figure 5. Months Before Deployment field used in model. 
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Vil. RESULTS, CONCLUSIONS, AND FURTHER STUDY 


A. RESULTS 


The results of this thesis are summarized below in Figure 6. 


NCEA and Model Forecasts versus Predicted Actual Expenditures 
FY-95 
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Figure 6. This graph depicts the savings achieved using the model in this thesis. The leftmost 
bar in each series is the NCEA -- the current prediction. The middle bar is the model’s 
prediction, and the rightmost bar is the estimated FY-95 actual expenditures. (Note: The first 
category of ordnance, FSC, is divided by 10 to allow it to fit on this graph.) 


In most cases, the tallest bar in each ammunition family is the FY-95 
NCEA issued by SURFPAC. The next highest bar in each family is the 
prediction using the fitted historical demand curves in this thesis. (Note the 


significant reduction in NCER.) The shortest bar indicates the expected actual 
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FY-95 expenditures which were predicted using linear regression on the first 
eight months of data for FY-95. (In order to fit all nine categories of ordnance 


onto one graph, the figures in the first series, FSC, were divided by ten. ) 


One can clearly see that the model estimations are much less 
overestimated than those calculated using the current methodology. Thus, using 
past expenditure data is definitely a viable method of predicting future 
expenditures. How accurate this model is in determining actual FY-95 
expenditures can only be determined at the end of this fiscal year, but the 


preliminary results are promising. 


B. CONCLUSION 


This thesis has demonstrated the power of a simple OR study in 
determining NCER levels for surface combatants of the U.S. Pacific Fleet. A 
vast improvement over the current methodology, this process has clearly shown 
that all ships are not created equal and that fiscal year expenditures vary sharply 
with ship type and location in the interdeployment training cycle. (LHAs expend 
far less ammunition than the ships studied in this thesis and possess even 
greater room for improvement since they are treated the same as a cruiser or 


destroyer.) 


Future augment requests will be expected to increase in number under 


this system due the lower NCEAs initially being assigned to each ship, but the 
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benefits of accurately predicting fleet NCER levels far outweigh the 


inconvenience of transmitting an NCEA augment request. 


For FY-95, the cost of the initially allocated rounds was in excess of 15 
million dollars. The cost of the model requirements for the same year was 
roughly 10 million dollars — a significant reduction. It may not be possible to 
save 5 million dollars each fiscal year using data analysis on 5°/54 caliber 
ammunition, but this thesis certainly proves the concept that vast improvements 
can be made in this area by applying some simple data analysis techniques. 
Not only will the initial procurement costs be reduced, but later costs of 
inspection, maintenance and storage of excess ammunition will be saved as 


well. 


C. FURTHER STUDY 

Inefficiencies exist throughout the conventional ammunition management 
system which deserve analytical study. This thesis scratched the surface of a 
huge problem. Further study could include validating this mode! against the 
actual FY-95 data and incorporating this data into a new and improved model — 
possibly using more independent variables to obtain higher resolution. These 
additional data variables could include major maintenance schedules, NSFS 


qualification dates, nature of the next deployment, and operational commander. 


The reader is reminded that CAIMS does not provide clean data to work 


with, and any future work will depend on the ability to accurately extract the 








actual expenditures from the reported transactions. Some other source of 
operational data is desired by operational commanders as well as analysts, but 


currently does not exist. 
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APPENDIX A. CAIMS DATA VALIDATION PROCEDURE 


As stated in previous chapters of this thesis, Conventional Ammunition 
Integrated Management System (CAIMS) data may not be a timely and reliable 
source of data for most applications. CAIMS is, however an accurate accounting 
trail of all transactions. By using careful and often tedious reconstruction 
techniques, this data can be transformed into a useful form. To remain focused 
on the task at hand, a consistent policy was developed and used. This Appendix 


details the procedures used by the author to validate the data used in this thesis. 


Step 1: Resolve any obvious errors. 

All data was tabulated and displayed by month on a timeline from 
December 1990 through May 95. Obvious accounting errors, account 
adjustments, and error correction transactions were located and resolved. For 
example, if a ship reported expending 96 rounds of a highly specialized type of 
ammunition in one month without expending any charges or practice ammunition 
in that month, it was assumed that this was an account adjustment and not an 


expenditure for training. 


Step 2: Resolve negative entries. 
All negative entries that remained after step one (55 of about 5100) were 
analyzed to find out what transaction they were used to correct. In most 


instances, the errors were obvious and correction was simple. In others, the 
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errors could not be found. Fortunately, none of the ships studied in this thesis 


had unresolvable errors. 


Step 3: Ensure projectile/charge ratio equals one for each 
month. 


Once all obvious errors were resolved, all expenditures were broken 
down into projectiles and charges which are expended in a 1:1 ratio. To resolve 
differing ratios, the assumption was made that the projectile reports were correct 
and that the charges could be redistributed based on projectile expenditures. 


This turned out to be a reasonable assumption with the following results. 


[J Projecto | charges [Tot 


Table 5. Effect of Validation on Raw Data. 











One can see from Table 5 that very little change in the total numbers of 
rounds expended occurred. Expenditures were simply redistributed month-to- 
month to recreate the actual expenditures based on the audit trail. On an 
individual ship basis, only seven of the 30 ships used for forecasts had changes 
in the FSC expenditures of one percent or more with the worst being 3.25%. 


(See Table 6). None had significant changes in other expenditures. 
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Ship Type _| Orig. Total | Validated % Change 

















ANTIETAM | CG 229 | 4a] -0.07 
Sune A te 
3846 

Co ana tai ee Sa De 
[LAKECHAMPLAIN ss | CG | 3640 | S646 | | 
LAKEERIE | CGT 1123 | tt 
MOBILEBAY | CG | 8862 | 8841-5 
PRINCETON, | CG 025 | 3025 | 
[SHILOH SSSCS~dYSCSCGSSC*dY~SCis99~—S«|~SCi600 | St | St 
VINCENNES | c | 2608 | 266 [42 | 0.44 
CUSHING | D707 | 91] te | 089 
DAVIDR.RAY | DT 856 | 3az7_ || 055 
ELLIOT. «= 27 | 895 || 068 
FIFE FF FCT tT tts | 
[FLETCHER | D848 | agg | tT 003 
HARRYW.HILL | DD | 2412245 
HEWITT T8213 | 8213 | 
INGERSOLL | DT 1846 | 846 | | 
KINKAID | D860 | 2354 |. 
WEFTWICH |p eiz | zie tg) 0.00 
MERRILL =| D242 | gz || 0.08 
O'BRIEN | 866 | t882 | 6 | 
OLDENDORF | DT 2026S | oz | |S 
[PAULF.FOSTER | DD | 2604 | 2752 | 58 





Table 6. Effect of validation procedure on Full Service Charges. Seven of 30 ships were altered 
by more than 1 percent with the worst being 3.25 percent. 
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APPENDIX B. AMMUNITION FAMILIES 


Ammunition Name Unit Cost 
(Dollars) 
Full Service Charge (Cork) 
HE-PD 802.50 
__D351_| PUFF-MT/PD,MK 120-0 | PUFF-MT | _—-524.00.—«| 
|_D291* | TP Smoke, PuffwMTF | PUFF-MT | _—-270.00.—=«| 
Reduced Charge 
|___D332_| VT, Non Self-Destructing | VT | -69750.—~« 


* indicates NCEA established for this NALC. Others in family are interchangeable. 
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APPENDIX C. OUTLIER STATISTICS 
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Table 7. CG-47/DDG-993 Outlier Statistics for 449 data points. 
( ) denotes series of all zero entries deleted. 
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Table 8. DD-963 Outlier Statistics for 458 data points. 
( ) denotes series of all zero entries deleted. 
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APPENDIX D. NCER FORECASTING GRAPHS 


The next 18 graphs contain the raw 12-month sums of expenditures for 
each ammunition and ship type. The first nine graphs are for destroyers and the 
last nine graphs are for the cruisers. Months before deployment is the 
independent variable for each ship type and is entered as described in Figure 7. 
The solid dots show the mean for each time slot, or the expected value of 


expenditures for a ship in that position in the interdeployment training cycle. 


The polynomial equation fit through the data is this model’s prediction of 
the NCER for a particular ship for next fiscal year. (Note that Appendix E lists 
standard deviations for each time slot if a different final figure is desired by the 
decision maker.) The straight line depicts the FY-95 NCEA assigned by 
SURFPAC. This is higher in most cases. The sinusoidal shape of the fitted 
curves clearly shows the dynamic nature of expenditure requirements throughout 


the interdeployment training cycle. 
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